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ABSTRACT 

This report describes the results of an institutional 
analysis that examined the effects of the CEO Horizon Scholarship Program on 
schools in San Antonio, Texas. The scholarship program offered virtually all 
families in the school district a scholarship to send their children to the 
school of their choice, both public and private. The analysis is based on 
information from focus groups conducted with parents of children in public 
and private schools, and from interviews with individuals knowledgeable about 
the school system. Some of the key findings indicate that parents with 
children in private schools generally believe that these schools are more 
responsive and committed than the public schools. Parents in both public and 
private schools were not satisfied with the values taught in public schools, 
with parent being concerned about peer pressure in the pubic schools and its 
negative effects on academic achievement. As regards the voucher program, the 
effects of the CEO Horizon Program on education practices and student 
achievement in public school were negligible. A comparison of test-score 
gains between the district and other districts that did not host a voucher 
program suggests that the program had no significant effect on test scores in 
the first year of operation. (RJM) 
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EXECUTIVE SUMMARY 



Over the past few years. Congress and many state legislatures have introduced school 
voucher proposals. Although the theory behind the role of vouchers in school reform anticipates 
the effects of vouchers on students, parents, and schools, most studies have focused only on the 
effects of vouchers on students and parents. In part, this thinking reflects the small scale of most 
voucher programs. The CEO Horizon Scholarship Program, sponsored by the Children First 
America Foundation and Dr. James Leininger, provides a unique opportunity to study the effects 
of vouchers at the school system level, because the program offers scholarships, or private 
vouchers, to virtually all families in the Edgewood Independent School District in San Antonio, 
Texas. 

In 1998, with funding from the David and Lucile Packard Foundation, Mathematica Policy 
Research along with researchers from Harvard University and the University of Texas at Austin 
began an evaluation of the CEO Horizon Scholarship Program. This report describes the results 
of an institutional analysis that looked at the effects of the program on the schools and school 
system in Edgewood. The analysis is based on information from focus groups conducted with 
parents of children in public and private schools, and from interviews with individuals 
knowledgeable about the school system. A companion report, documenting findings from a 
survey of parents with children attending public and private schools in Edgewood and test results 
for students, was released in 1999. 1 

Some of the key findings from this study include: 

• Parents with children in the private schools generally believe that these schools are 
more responsive and committed than the public schools. Parents were more inclined 
to complain about little or no communication, rather than about negative 
communication, from the public schools. 

• Parents' reports about public and private schools meeting the requirements of students 
with special needs were mixed. Some parents reported that they had expected the 
private schools to have better specialized services for education. Other parents, told 
us that students that public schools had identified as having special needs were now 
excelling in regular classrooms in private schools. 



'The previous report showed that a wide variety of students and families took advantage of 
the scholarships. It noted that the scholarship students and families resembled public school 
students in some respects but differed modestly in others. For example, scholarship students had 
similar math test scores and somewhat higher reading test scores than students in public schools; 
scholarship students were less likely to have learning disabilities than students in public schools; 
and the incomes levels of the scholarship and public school students were nearly the same. See 
Peterson, Paul E., David E. Myers, and William G. Howell, “An Evaluation of the Horizon 
Scholarship Program in the Edgewood Independent School District, San Antonio, Texas: The 
First Year.” 
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• Parents of children in both public and private schools are not particularly satisfied 
with the values taught in public schools. For some parents, the religious instruction in 
private schools fills the values gap left by public schools. 

» Parents of children in public and private schools are concerned about peer pressure in 
the public schools and believe it is not conducive to academic achievement. Parents 
also expressed fears about the violence they perceived in the Edgewood public 
schools. 

• Parents’ had mixed assessments of the amount of disruption caused by the transition 
from a public school to a private school. For some children, the transition was 
smooth; for others, it was difficult. Many parents noted that private schools offered 
tutoring and other special assistance to ease the transition. Some evidence points to 
the transition being more difficult for older students. 

• The effects of the CEO Horizon scholarship program on education practices and 
student achievement in the public schools were negligible. After the first year of the 
program, there is little evidence that Edgewood made significant changes in broad 
education practices, school policy, or operations. 

• Test score gains observed in Edgewood were matched by gains in other nearby school 
districts not hosting a voucher program. This pattern suggests that the CEO Horizon 
program had no significant effect on test scores in the first year of operation. 

• The limited effect of the CEO Horizon program on the Edgewood school district may 
be attributable to several factors. First, during the period studied, the program had 
only been in place for one year. Second, the Edgewood school district had financial 
reserves that delayed the immediate financial impact of losing students to other 
schools. Finally, the district’s political dynamics appeared to offer few political 
incentives to change and to fragment leadership. 
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Over the past few years, Congress and many state legislatures have introduced school 
voucher proposals. In addition, three publicly funded programs are currently operating in 
Milwaukee, Cleveland, and Florida. A large number of voucher programs (80) have been 
privately funded as well — in New York City; Washington, D.C.; Dayton, Ohio; San Antonio, 
Texas; Indianapolis, Indiana; and San Francisco, California — and there is one privately funded 
nationwide program. Although th'\ theory behind the role of vouchers in school reform 
anticipates the effects of vouchers on students, parents, and schools, most studies of vouchers 
have focused on the effects of vouchers only on students and their parents. In part, this reflects 
the scale of most voucher programs, which is typically small. 1 In small-scale programs, one 
would not expect to see systemic change at the school level brought about by the threat of 
potentially losing students to competing schools. In large-scale voucher programs, however, 
where all children in a school district or school are eligible for a voucher, one might reasonably 
expect to see evidence for the effects of vouchers on schools. The CEO Horizon Scholarship 
Program, sponsored by the Children First America Foundation and Dr. James Leininger, a 
resident of San Antonio, provides a unique opportunity to study the effects of vouchers at the 
school level because the program offers scholarships, or private vouchers, to virtually all families 
in the Edgewood Independent School District in San Antonio. 

A. STUDY PURPOSE AND BACKGROUND 

In 1998, with funding from the David and Lucile Packard Foundation, Mathematica Policy 
Research along with researchers from Harvard University and the University of Texas at Austin 
began an evaluation of the CEO Horizon Scholarship Program. The evaluation plan called for a 



'Exceptions include the publicly funded voucher programs in Milwaukee, Cleveland, and 
Florida, and the privately funded program in San Antonio, Texas. 
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two-pronged approach to learning about the effects of vouchers on schools, students, and parents. 
The first prong involved a longitudinal analysis in which the study team planned to compare the 
school experiences and test scores of students in Edgewood with the school experiences and test 
scores of similar students in three comparison school districts in Texas. The second prong of the 
evaluation called for an institutional analysis in which the experiences of the schools in the 
districts would be compared. 

During the first year of the evaluation, Mathematica collected baseline data through a parent 
and a student survey, and by giving students the Iowa Test of Basic Skills to measure their 
educational achievement. We selected parents and students by identifying a representative 

sample of households with children in each of the districts, and they were invited to the data 

2 

collection sessions, where the parents completed survey forms and the children took the test. 

Mathematica also initiated the institutional study during the first year of the evaluation. 
Unfortunately, the evaluation was challenged by the public schools in the four communities, and 
Mathematica and its study team were denied access to the schools and their staff. We therefore 
limited the institutional analysis to Edgewood. Furthermore, unable to interview school staff or 
observe school operations, the study team had to rely on information provided by informed 
sources outside of the school system and on administrative records obtained under the Freedom 
of Information Act. 

Given the lack of access to the public schools, and the difficulty and expense of collecting 
parent and student data, Mathematica and the study team met after completing the first round of 
data collection to consider next steps. The decision was made to recommend to the funder of the 

2 For a detailed description of this phase of the study, see Peterson, Paul E., David E. 
Myers, and William G. Howell, “An Evaluation of the Horizon Scholarship Program 
in the Edgewood Independent School District, San Antonio, Texas: The First Year.” 
http://www.data.fas.harvard.edu/pepg/ 



evaluation that the study not be continued. This report documents what was learned through 
May 2000 from the institutional analysis under the constraints imposed on the evaluation by the 
public schools. We describe the CEO Horizon Scholarship Program and discuss its effects on 
the following aspects of the Edgewood school system: parent satisfaction with the public and 
private schools attended by their children, education practices and student achievement, and 
school district policy and operations. We also offer explanations for why the effects on systemic 
change in the Edgewood public schools may have been weaker than what proponents of 
vouchers may have hoped for. 



B. PROGRAM DESCRIPTION 

The CEO Horizon Scholarship Program began offering virtually all families in Edgewood a 
scholarship to send their children to the school of their choice beginning in the 1998-99 
academic year. To ensure continuity in education, the Children First America Foundation and 
Dr. James Leininger have pledged to support the program for 10 years, at a commitment of up to 
$50 million for scholarships. Parents may use the scholarships to send their children to private 
schools within the district, private schools outside the district, or to public schools outside the 
district if those schools will accept the students. 3 More than 550 students, or nearly 4 percent of 
the students in Edgewood public schools, accepted a scholarship offer during the first year of the 
program. In this section, we describe the community and the students served by the program; the 
scholarship eligibility criteria, structure, and take-up rates; and the private schools in which the 
scholarship students have enrolled. 



3 The scholarship amount for out-of-district schools is limited to the tuition charged by out- 
of-district schools, which is capped by the limits imposed on the amount of the scholarship. 
Within-district schools are allowed to keep whatever difference exists between the cost of tuition 
and the amount of the scholarship; CEO used this approach to encourage within-district schools 
to increase their capacity to enroll more students. 
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